fix(deps): update dependency @vercel/agent-eval to ^0.14.0#13
Open
renovate[bot] wants to merge 1 commit intomainfrom
Open
fix(deps): update dependency @vercel/agent-eval to ^0.14.0#13renovate[bot] wants to merge 1 commit intomainfrom
renovate[bot] wants to merge 1 commit intomainfrom
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
renovate
Bot
force-pushed
the
renovate/vercel-agent-eval-0.x
branch
from
fe67cce to
92b12c7
Compare
renovate
Bot
changed the title
renovate
Bot
force-pushed
the
renovate/vercel-agent-eval-0.x
branch
from
92b12c7 to
a601422
Compare
renovate
Bot
changed the title
renovate
Bot
force-pushed
the
renovate/vercel-agent-eval-0.x
branch
from
a601422 to
0e2b31b
Compare
renovate
Bot
changed the title
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR contains the following updates:
^0.11.0→^0.14.0Release Notes
vercel-labs/agent-eval (@vercel/agent-eval)
v0.14.0Compare Source
Minor Changes
07614ecThanks @allenzhou101! - Add response-only eval support, post-run analysis hooks, and brand definitions.v0.13.1Compare Source
Patch Changes
384133bThanks @gaojude! - Surface AI Gateway errors during classification instead of swallowing them.classifyWithAIandclassifyFailurenow throw on gateway/network failures, andrunAllCommandcollects per-eval classifier errors and prints them at the end of the classify phase. Previously a 402 (insufficient funds), network blip, or any other gateway error would silently leave failures with noclassification.json, which the cache reuse path then refuses to reuse — causing those evals to re-run on every subsequent invocation.v0.13.0Compare Source
Minor Changes
660ea3eThanks @gaojude! - Remove auto-retry of non-model failures. The--max-retriesflag is gone; non-model failures are now removed by default (re-run to retry) or kept with--ack-failures.v0.12.1Compare Source
Patch Changes
a3c2136Thanks @gaojude! - Reconnect on terminated HTTP streams inSandboxManager.runCommand/runShellso in-sandbox commands exceeding ~5 min don't fail spuriously witherror: "terminated".v0.12.0Compare Source
Minor Changes
a209ae0Thanks @gaojude! - AddcliPackageandeffortagentOptionsfor Claude Code. Lets users override the installed npm package (e.g.@anthropic-ai/claude-code@next) and pass--effort <level>, which is required by models that use the newthinking.type.adaptiveAPI such as Opus 4.7.Configuration
📅 Schedule: (UTC)
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR was generated by Mend Renovate. View the repository job log.